Coupling Forward-Backward with Penalty Schemes and Parallel Splitting for Constrained Variational Inequalities

We are concerned with the study of a class of forward-backward penalty schemes for solving variational inequalities 0 ∈ Ax+NC(x) where H is a real Hilbert space, A : H ⇉ H is a maximal monotone operator, and NC is the outward normal cone to a closed convex set C ⊂ H. Let Ψ : H → R be a convex differentiable function whose gradient is Lipschitz continuous, and which acts as a penalization function with respect to the constraint x ∈ C. Given a sequence (βn) of penalization parameters which tends to infinity, and a sequence of positive time steps (λn) ∈ l 2 \ l, we consider the diagonal forward-backward algorithm xn+1 = (I + λnA) −1(xn − λnβn∇Ψ(xn)). Assuming that (βn) satisfies the growth condition lim sup n→∞ λnβn < 2/θ (where θ is the Lipschitz constant of ∇Ψ), we obtain weak ergodic convergence of the sequence (xn) to an equilibrium for a general maximal monotone operator A. We also obtain weak convergence of the whole sequence (xn) when A is the subdifferential of a proper lower-semicontinuous convex function. As a key ingredient of our analysis, we use the cocoerciveness of the operator ∇Ψ. When specializing our results to coupled systems, we bring new light on Passty’s Theorem, and obtain convergence results of new parallel splitting algorithms for variational inequalities involving coupling in the constraint. We also establish robustness and stability results that account for numerical approximation errors. An illustration to compressive sensing is given.